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The present invention relates to an ijnage processing device, 
and in particular to a game device. The present invention also 
relates to an input device that generates a signal specifying 

l0 a position on a screen in a display means . and outputs the signal 
to an image processing device. More specifically, the present 
invention relates to an image processing device and its input 
device, which are used in a game device. Even more specifically, 
the game device relates to the field referred to as "whacking 

15 games, • such as the familiar "mole-whacking game, » where a target 
is struck with a hammer or the like. 

in the past, game devices referred to as "whacking games" 
20 have been constructed in such a way that something which is in 
the shape of a mole, for example, and which is to be struck (herein 
after referred to as "object") is mechanically moved up and down 
or back and forth according to a prescribed system through 
openings in the front of a case unit. The player strikes the 
25 object with a special hammer in a contest with other players over 
the strikes. 

To determine the winner, the game device determines whether 
or not the strikes are successful under a fixed system. When a 
strike is judged to be successful, the game device awards a point, 
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which is displayed to the player, and the player can thus compete 
with other players over these points. 

The following problems occur in conventional -whacking- 
games, however, because the object appears mechanically. 
5 ,i, The special hammer is usually furnished with a buffer 

material to soften the impact of the strike, but the mechanical 
structure from which the object emerges must be durable because 
of the substantial force and vigor with which the object is struck . 
The design of the mechanical structure is thus limited. For 
1. example, mechanical parts with high strength must be used, or 
the front of the object must meet certain requirements, such as 
the need to be formed into a spherical shape with excellent 
performance in dispersing stress. This limits the shape of the 
object, adding to the cost of manufacturing this type of game 
15 device. 

(ii , Because the object pops up and drops down by means of 
a mechanical structure, the movement of the object is limited 
to a reciprocating movement either u P and down or backward and 
forward, making it difficult to achieve more diverse object 
2 0 movement . 

M object of the present invention is thus to provide a device, 
or a peripheral structure thereof, that gives input by contact 
based on strikes or the like to an object while affording object 
movement that is not limited to a mechanical structure, and that 
25 executes prescribed image processing based on this input. 

Another object of the present invention is to provide a game device 
employing this input. 
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iMfirTippnrr ^ tuf tmotbttow 

A to achieve these objects, the present invention executes 
object movement by image processing means^and executes the 
prescribed processing based on contact data.by input means to 
5 display means for displaying the moving object. 

The present invention comprises : image processing means for 
executing image processing to move an object; display means for 
displaying an image based on this i^age processing; contact input 
mea „s that is movably provided and is brought into contact with 
1. the display means by the operation of a player, and that generates 
a signal for computing the contact position when brought into 
contact with the display means; position computing means for 
computing the contact position based on signals from the contact 
input means; and determination means for determining whether or 
15 not a prescribed relationship is established between the contact 
position and the object display position based on the computed 
results, wherein the image processing means provides preserved 
i^ge processing for the object when it has been determined by 
the determination means that a prescribed relationship has been 

20 established. 

in the present invention, it is determined whether or not 
there is a prescribed relationship between the location where 
the object is displayed and the point where the input means is 
brought into contact with the display means, for example, when 

25 the point of contact is included in the region where the object 
is present (when the two collide) , and theprescribed image 
processing is executed when it has been deterged that such a 
relationship has occurred. The game device is constructed in 
such a way that points are awarded when such a relationship has 
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be en determined, so as to determine the winner of the game being 
played with the input means. 

For example, because the object movement is executed by image 
processing, there are fever restrictions in the design of the 

„,=„*■ aiiowinq more diverse shapes and 
5 object shape and movement, allowing 

movements to be freely provided. 

In the present invention, the input means is operated so 
as to come into contact with the display means (or protective 
glass or the li*e, . when the input means comes into contact with 
l0 the display means, the data necessary for computing the contact 
point is output to the position computing means. The position 
computing means computes the point of contact based on this data, 
and the determination means determines whether or not a prescribed 
rel ationship has been established between the object and the input 
15 means based on the computed results, when it has been determined 
by the determination means that such a relationship has been 
established, the image processing means provides the prescribed 
i^age processing for the object, and the game device awards a 
point* 

20 The display means is preferably a CRT display, and even more 

preferably a protective cover is provided on the front of the 
CRT display. The front of the image display surface or the 
protective cover of the display means is arranged so that the 
angle formed by the normal line in the center with respect to 
25 the perpendicular direction ranges from 3 to 17 degrees. Such 
an incline maKes it relatively easier to bring the input means 
into contact with the display means. 

The input means is furnished with a switch means allowing 
data to be output when brought into contact with the display means , 
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so as to prevent data fro, being unintentionally output when no 
contact is made. The switch means is preferably a vibration 
switch • 

v~ *-h* nresent invention further 
The device pertaining to the present in 

5 comprises photoreceiver means for light emitted fro, the scanning 
Unas of the « display serving as the display means. The 
position costing means begins the necessary processing to 
obtain the point of contact based on output from the switch means . 
When a detection signal is input from the photoreceiver means, 
L0 data on the position of the scanning point obtained based on the 
scan synchronizing signal is incorporated, and the point of 
contact is computed based on this data, allowing the contact pent 
to be accurately and rapidly computed. 

Since the input means is furnished with a buffer to soften 
15 the impact during contact at the position of contact on the display 
means, the input means and display means are more durable. 

The present invention is also a recording medium on which 
is recorded the procedure by which the aforementioned method is 
executed by the processing device. Examples of recording med.a 
20 include floppy disks, magnetic tape, photomagnetic disks , CD-ROM, 
DVD, ROM cartridges, battery back-up-eguipped RAM memory 
cartridges, flash memory cartridges, and nonvolatile RAM 
cartridges . A recording medium is that on which data is recorded 
by any processing means (primarily digital data and programs,, 
2S allowing the desired function to be achieved by a processing 
device such as a computer or a dedicated processor. 
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mlfi? rF gppTPTTOH OF THF OBAWTNgS 

Fi g 1 is ^view depicting the image processing 
* device and input device pertaining to the present invention; 

Y , the SpUY-SSSM-i Pro^ctiv^r of the image processing 
d^gi^r s tf ratted i ^ la txve-^r^r^te^ 

Pig. 3 is a cross section depicting the relationship in which 

nrotective glass of the image processing 
the display means and protective gj.* 

device are arranged relative to each other; ^ 

Fig . 4 is a side view depicting the appearance of A «h» input 
device pertaining to the present invention; 

Fig . 5 is a cross section depicting the interior of the input 

device; 

Fig. 6 is a block diagram depicting the structure of a 
vibration switch component used in the input device; 

Fig. 7 is a block diagram depicting the structure of a 
photodetector substrate used in the input device; 

pta Jjlng by the iB ^e-progSssmg aevtey- 

Fig , f is J^ock diagram depicting^detail * the signal 
* processing^ the image processing device; 

Fig. 10 is a flow chart illustrating the main processing 
operations of the processing device; 

Fig. 11 is an illustration of a game selection guidance Unage 
25 in the main processing operations of the image processing device, 
Fig. 12 is a flow chart for determining the position of the 
input device on the surface of the display means in .the i»age 
processing device; 
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Fig. 13 is a timing chart of the position determining 
operations 4» the image processing device; 

Fig. 14 is a schematic depicting a second embodiment of the 

input device; 

Fig. 15 is a schematic depicting a structural example of 
a vibration switch used in the input device; 

Fig. 16 is a schematic depicting a third embodiment of the 

input device; and 

Fig. 17 is an illustration of the operation of the third 

embodiment of the input device. 

nnpTi vm irmnTTtn Tim 

A 

Embodiment 1 of the invention 

Embodiments of the present invention are described below 
1 with reference to examples depicted in the attached drawings - 

0 . Fiq l is A «*«**ig»»- ^ depicting th P imagft ^o ^oing devi c e 
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20 



25 



.device pertaining to the present invention, yjfie^*-** 
4 ^ Rto ^e a the game d s ^ m ai n u i.i t ; and th e-sy mbo l 2 indiea^r 
*»p*t devices in the form of hammers (input devices) . The^e- 
device main unit 1 comprises a trapezoidal case unit 3, a display 
board 4 standing upright from the surface of the case unit 3, 
and a box 5 located above the display board 4. 

Cylindrical bodies 3a and 3b are provided for the sake of 
design at the top on either side of the case unit 3. The 
cylindrical bodies 3a and 3b are equipped with cylindrically 
notched housing components 7a and 7b. The handles of the hammers 
2 can be housed in the housing components 7a and 7b. 
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Pi 

-*be top surface 8 of the case unit 3 is designed so as to 
A 

tilt lower on the player side (side opposite the display board 
4) , making it more convenient , as described below, for the player 
to strike the protective glass 10 with the hammer. A CRT display 
5 or video projector 9 (hereinafter simply referred to as "display"), 
for example, is provided as the display means at the top surface 
8. As shown in Figs. 2 and 3, protective glass 10 is placed on 
the display 9, The protective glass 10 prevents the force of the 
impact from the hammer- type input device 2 from falling directly 

10 on the display 9. The protective glass is also considered the 
display means in the present invention. Ordinarily, as described 
below, the tip of the hammer is provided with a buffer means for 
the stress, such as a bellows made of resin. The protective glass 
is not an indispensable structural element in the present 

15 invention ♦ 

A conventional coin slot or other such device is provided 
in front under the display 9 (and protective glass 10) ■ The coin 

ft slot or other such device 1 1 A L a KJ on ot r rttetrod - *crfr a coin slot for 
entering coins, a coin return slot for returning coins, a coin 

20 ^f ood r- handling circuit that giv oo mrt rjrr6"gYrard- a - tQ proee s-s-i ng board ' 
"des- er - ibed below that— a coin - hoo- boon incortod, or the liko > 

/\ Display panels 12 etc. comprising^ segments of light- 

emitting diodes or the like are located in the aforementioned 
display board 4 to display game results or other necessary related 

25 data. Speakers 13 - and 1 > are arranged at a prescribed distance 
from each other inside the box 5. 

A data processing board 15 is provided inside the case unit 
3 of the game device main unit 1 . Examples of the main processes 
of the data processing board 15 include game start processing, 
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image signal formation processing, sound signal formation 
processing, input signal processing, screen coordinate position 
calculation (specification) processing, and score display 
processing. The display 9, hammer-type input devices 2 , speakers 
5 13, display panels 12, and coin slot or other related device 11 
^ are electrically connected by signal wiresQnot^ jL a dico - tQd in the 
A figure) to the data processing board 15. 

The game device main unit 1 and the hammer-type input device 

A> ********* A****, ftU*P 

2^ K>vo - 4^ho otructu - r^ - d e scrib e d abo v e r allowi n g one or two players 

10 to hold a hammer 2 in their hands and use the hammer to strike 
moving objects such as mice (the objects to be struck) while 
watching the game screen displayed by the display 9 in a contest 
over the strikes such as the number of strikes or the time needed 
until the object is struck. The object should move in a way that 

15 cannot be anticipated or predicted by the player. 

The layout of the aforementioned display and protective 
glass are illustrated in further detail in Figs . 2 and 3 . The 
display 9 is set up at an incline so that the player side Py of 
the screen on the display 9 is lower. The protective glass 10 

20 is set up at a fixed distance d parallel to the display 9 over 
the screen on the display 9, and is supported and secured by a 
base 14. Since the display 9 and protective glass 10 are 
downwardly inclined toward the player side, the hand holding the 
hammer can easily reach the entire display, even when the display 

25 is relatively large. The incline is such that the normal line 
in the center of the display form an angle of preferably 3 to 
20 degrees, more preferably 3 to 17 degrees, and even more 
preferably 5 to 15 degrees, with respect to the perpendicular 
direction. 
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The appearance and structure of the hammer- type input device 
2 used in the image processing device are depicted by the side 
view in Fig . 4 . 

The input device 2 as a whole is in the form of a hammer, 
5 consisting of a bar-shaped handle 16 and a cylindrical head 17 ♦ 
The handle 16 is constructed in the form of a cylindrical bar 
with a flexible material. The head 17 is fixed at right angles 
to the tip of the handle 16 , and a grip 18 is provided at the 
base. The tip of the head 17 is provided with a bellows as a buffer 
10 to soften the impact when the input device is brought into contact 
with the protective cover. Switch means and detection means, 
described below, may be housed in the handle 16 , head 17, and 
buffer 19. 

Fig. 5 is a cross section depicting the internal structure 
15 of the hammer-type input device. Switch means 20 housed in the 
hammer-type input device 2 outputs a trigger signal when the 
action of striking the protective glass 10 occurs. Here, the 
switch means 20 is provided in the form of a structure with a 
vibration switch 22 located in the head 17. When impact force 
20 of a certain level reaches a vibration sensor (described in detail 
below) , the switch is turned off, for example, and the vibration 
switch 22 outputs an operating signal. 

/ ^i*e>detection means 21 housed in the hammer- type input device 
2 is provided to obtain signals for computing which position on 
25 the display screen has been struck by the hammer. The detection 
means 21 is constructed of a photodetector substrate 23 provided 
in the interior of the head 17. The photodetector substrate 23 
is described in detail below. In the photodetector substrate 23 , 
light L from the scanning lines , which comes from below the bellows 
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buffer 19 in the figure, is guided to a photoreceiver sensor 25 , 
is converted to an electrical signal by the photoreceiver sensor 
25, is then treatted to create a constant signal, and is output 
in the form of a photodetector signal. A photodiode, 
5 phototransistor , or the like may be used as the photodetector 
sensor 25. The operating switch of the vibration switch 22 and 
the output signal from the photodetector substrate 23 are fed 
to the data processing board 15 by signal lines 26 and 27 r 
respectively. 

10 Fig. 6 is a block diagram depicting the structure of the 

vibration switch 22 in the hammer- type input device 2 . The 
element constituting the vibration switch 22 is integrally 
constructed on a substrate. A shock sensor 220 is an element 
outputting an electrical signal corresponding to the impact force 

15 when impact occurs. The output of the shock sensor 220 is 

connected to an amplifier circuit 221, and the output signal of 
the shock sensor 220 is amplified by the amplifier circuit 221 
to the prescribed level. 



20 input terminal of a comparator 223, so that the output signal 
can be applied to the one input terminal of the comparator 223. 
The reference voltage Vrf 1 from a reference voltage feed circuit 
224 is applied to the other input terminal of the comparator 223 . 
The comparator 223 outputs a shock detection signal when the 

25 output voltage from the amplifier circuit 221 is greater than 
the aforementioned reference voltage Vrfl. The shock detection 
signal is managed in such a way as to allow the output of an 
operating signal Ss through the delay of a prescribed time for 
the adjustment of the processing time, for example, by a delay 



The output of the amplifier circuit 221 is connected to one 
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circuit 225. 

Fig. 7 is a block diagram depicting the structure of the 
photodetector substrate 23 in the aforementioned hammer-type 
input device 2. in the figure, the photoreceiver sensor 25 is 
5 an element that detects the light L from the display 9 and converts 
it to an electrical signal. As described above , the 
photoreceiver sensor 25 may be constructed of a photodiode, 
phototransistor , or the like. The output of the photoreceiver 
sensor 25 is connected to an amplifier circuit 231 , and the output 

10 signal from the photoreceiver sensor 25 is amplified by the 
amplifier circuit 231 to the prescribed level. The output from 
the amplifier circuit 231 is connected to one input terminal of 
a comparator 233 , allowing the output signal to be applied to 
the one input terminal of the comparator 233. The reference 

15 voltage Vrf2 from a reference voltage feed circuit 234 is applied 
to the other input terminal of the comparator 233 . The comparator 
233 outputs a photodetector signal Sh when the output voltage 
from the amplifier circuit 231 is greater than the aforementioned 
reference voltage Vrf 2 . 

20 Fig. 8 is a block diagram depicting a schematic structure 

of the processing between part of the structure of the image 
processing device and the hammer-type input device in the present 
invention. In the figure, the vibration switch 22 inside the 
hammer-type input device 2 and the photodetector substrate 23 

25 are connected through a signal line 26 and signal line 27 , 

respectively, to the I/O interface 310 of a CPU block 30 in the 
data processing board 15. The data processing board 15 is 
described in the form of one consisting of the CPU block 30 and 
video block 31 in Fig. 8. 
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The CPU block 3 0 of the data processing board 15 runs the 
game according to a prescribed program/ and specifies which 
position on the screen of the display 9 has been struck by the 
hammer-type input device 2 based on the photodetector signal from 
5 the photodetector substrate 23 when an operating signal from the 
vibration switch 22 is input, allowing this to be reflected in 
the contents of the game. 

The video block 31 in the data processing board 15 sends 
the game image signals (video signal Vs and synchronizing signal 

10 Cs) prepared on the basis of the results processed by the board 
to the display 9. The data processing board 15 also gives data 
such as the score to the display panels 12 (see Fig. 1) P and gives 
the prescribed sound signals to the speakers 13 in Fig. 1 (see 
Fig. 1) . Processed images are thus displayed on the display 9, 

15 the necessary score or the like is displayed on the display panels 
12 (see Fig. 1), and sounds are reproduced from the speakers 13 
(see Fig. 1) according to the processing results. 

Fig. 9 is a block diagram depicting a detail of the image 
processing device, in the figure , the data processing board 15 

20 is constructed of a CPU block 30 for controlling the entire device, 
a video block 31 for controlling display on the game screen, a 
sound block 32 for producing resulting sounds and the like, and 
other power source circuits or the like. 

The CPU block 30 is constructed of a SCU (system control 

25 unit) 300, main CPU 301, RAM 302, ROM 303, subCPU 304, CPU bus 
305, input-output circuit block 306, reference input board 307, 
extension input board 308, reference output board 309, and the 
like. The main CPU 301 controls the entire device. The main CPU 
301 has the same computing function as a DSP (digital signal 
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processor) inside, and can execute application software at high 
speeds . 

The RAM 302 is used as a work area for the main CPU 301. 
An initialization program for initializing processing, a 
5 processing program for the entire game, and the like are written 
to the ROM 303. The SCU 300 ensures the smooth input and output 
of data between the main CPU 301 f ^ VDP ( video display processo^ 
1 (320), VDP 2 (330), SCSP 340, and the like by controlling the 
buses 305, 310, and 311. 

10 The SCU 300 is equipped with a DMA controller inside, and 

can send character data in the game to the VRAM 321 in the video 
block 31 . Application software for the game and the like can thus 
be executed at high speed. The subCPU 304 collects operating 
signals from the hammer-type input device 2 connected to the 

15 reference input board 307 and photodetector signals from the 
hammer-type input device 2 connected to the extension input board 
308 according to commands from the main CPU 301, determines the 
position of the hammer-type input device 2 on the screen, and 
gives the necessary score from the reference input board 3 07 to 

20 the display panels 12. The subCPU 3 04 thus controls peripheral 
devices - 

The main CPU 301 controls images related to characters 
(including the object) in the game screen, for example, based 
on operating data received from the subCPU 304. The video block 
£ 25 31 is equipped with a first VDP ( v i deo diopl - oy prococGOE) . 320 
for visualizing a two-dimensional sprite screen in which 
characters are primarily superimposed over other background 
images, and a second VDP 330 for visualizing scroll background 
screens, synthesizing images with sprite image data and scroll 
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image data, clipping, and the like. Here, characters may also 
be composed of three-dimensional data involving the synthesis 
of a plurality of polygons instead of sprites. 

The first VDP 320 houses a system register, and is connected 
5 to VRAM (DRAM) 321 and a two-sided frame buffer 322, The game 
character image data is sent from the main CPU 301 through the 
SCU 300 to the first VDP 320, and is written to VRAM 321. The 
image data written to VRAM 321 is visualized, for example, in 
the visualizing frame buffer 322 in an 8-bit /pixel format. The 

10 visualized frame buffer 322 data is sent to the second VDP 330 
during display mode. 

The data for controlling visualization is set from the main 
CPU 301 through the SCU 300 to the system register of the first 
VDP 320. The first VDP 320 controls visualization and display 

15 according to commands set by the system register. 

The second VDP 33 0, meanwhile, houses a register and color 
RAM, and is connected to VRAM 331. The second VDP 330 is also 
connected through the bus 307 to the first VDP 320 and SCU 300, 
and is connected through a D/A converter 3 60 to the display 9. 

20 The scroll image data for the second VDP 330 is defined from 



the main CPU 301 through the SCU 300 to VRAM 331 and color RAl^ 
Data for controlling the image display is similarly established 
in the register of the second VDP 330. Data defined at VRAM 331 
is read out by the second VDP 330 according to the contents defined 
25 in the register, and is converted to scroll screen image data 
showing the background for the characters . The display priority 
of the image data sent from the scroll screen image data and first 
VDP 320 is determined according to the definitions in the register, 
resulting in synthesis into the final display image data. 
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When the display image data is in palette format, the color 
data defined in color RAM is read out according to value by the 
second VDP 330, and the display color data is thus produced. When 
the display image data is in RGB format f the display image data 
5 serves as the display color data without modification. The 
display color data is output to the D/A converter 360. The D/A 
converter 360 produces image signals by adding synchronizing 
signals to the jjnage data for output to the display 9 . Game images 
are thus displayed on the display 9. 

10 The sound block 32 is equipped with a DSP 342 for synthesizing 

voice according to PCM or FM format, and an SCSP 340 for 
controlling the DSP 342 or the like. The voice data produced by 
the SCSP 340 is converted to voice signals by the D/A converter 
370, which are then output to the speakers 13. 

15 The operation of the image processing device is described 

below with reference to Figs. 10 through 13 based on Figs. 1 
through 9. First, the overall flow of operations is described 
using the main flow chart in Fig. 10 and the illustration of the 
game selection screen in Fig, 11. when a coin is inserted into 

20 a coin slot or other related device 11 (step 501 in Fig. 10), 
the main CPU 301 is notified of this through the subCPU 304. The 
main CPU 301 produces a short and simple opening demonstration, 
and gives the data to the first VDP 320 and SCSP 340 through the 



A SCU 300 (steppe*) . The first VDP 320 thus produces the opening 
25 demonstration images and gives them to the display 9. The 

prescribed demonstration is thus displayed on the display 9. The 
necessary sound data is produced by the SCSP 340 and is given 
to the D/A converter 370. The D/A converter 370 converts and 
outputs analog signals to the speakers 13. 



SO* 
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When the demonstration is completed/ the main CPU 301 then 
sends the data for producing the game selection screen through 
the SCU 300 to the first VDP 320 (step 503), Four screens, for 
example, are thus produced by the first VDP 320 and are given 
5 to the D/A convertor 3 60. The image signals from the D/A convertor 
360 are given to the display 9. A guide screen 600 giving a 
selection of four game modes 601, 602/ 603, and 604, as shown 
in Fig. 11 , for example, is displayed on the display 9. The four 
game modes 601, 602 , 603, and 604 are provided so as to allow 

10 objects with different behavior to be selected, where, for example, 
the symbol 601 is "mouse-whacking, " 602 is "alligator-whacking/" 
603 is "crab-whacking," and 604 is " bee-whacking. " 

Here, when the player selects one game from the guide screen 
601 (step 503), the selected game is executed by the main CPU 

15 301/ allowing the player to play the game while watching the 
display 9 (step 504). When the game is over, the main CPU 301 
determines whether the game has been cleared (step 505). When 
it has been determined by the main CPU 301 that the game has been 
cleared (step 505: YES), a "cleared" demonstration image is 

20 produced, and is sent through the SCU 300 to the first VDP 320 
and SCSP 340 (step 506). The "cleared" demonstration ijnage 
signals are thus formed by the video block 31, and the "cleared" 
demonstration sound signals are formed by the sound block 32. 
The display 9 displays the images via the image signals- The 

25 "cleared" demonstration sound signals are reproduced as sound 
from the speakers 13. By concluding the "cleared" demonstration 
process, the main CPU 301 produces "game over" images, which are 
sent through the SCU 300 to the first VDP 320 and SCSP 340 (step 
607). The "game over" images are thus provided on the display 
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9, and sounds indicating that the game is over are provided by 
the speakers 13. 

When it is determined by the main CPU 301 that the game is 
not cleared (step 505: NO), meanwhile, "not cleared" 

5 demonstration images are produced , and are sent throuqh the SCU 

Yt>? 

A 300 to the first^Bf* 320 and SCSP 340 (step 508). "Not cleared" 
demonstration image signals are thus formed by the video block 
31, and "not cleared" demonstration sound signals are formed by 
the sound block 32. The image signals are converted into images 
10 by the display 9. The "not cleared 11 demonstration sound signals 
are reproduced in the form of sound from the speakers 13. By 
concluding the "not cleared" demonstration process, the main CPU 
301 produces "game over" images and sends them through the SCU 
300 to the first VDP 320 and SCSP 340 (step 506). Images 
15 indicating that the game is over are thus provided on the display 
9, and sounds indicating that the game is over are provided by 
the speakers 13. 

Here, in the course of game play (step 503), an object in 
the form of a mouse, for example (the object to be struck, 
20 hereinafter referred to as "object" ), appears and disappears on 
the screen of the displayiT^Wi^n the object appears, the player 
uses the hammer-type input device 2 to strike the object on the 
screen of the display 9. At this time, the subCPU 304 executes 
the process for receiving the operating signal Ss and 
25 photodetector signal Sh from the hammer-type input device 2 (see 
Fig. 8) or for outputting output signals to display the score. 

Here, the hammer-type input device 2 strikes the protective 
glass 10. As such, the vibration switch 22 of the switch means 
20 in the hammer-type input device 2 is activated and outputs 
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an operating signal Ss. At this time, the subCPU 304 receives 
the signal Ss, and the main CPU 301 is notified. The main CPU 
301 executes the image position-specifying operations. These 
image position-specifying operations are described with 
5 reference to Figs. 12 and 13. Here, Fig. 12 is a flow chart of 
the position-determining operations in the image processing 

■VWa-V sWs. •«***' 

device. Fig. 13 is a timing chart^during the position- 
determining operations in the image processing device. In Fig. 13 , 

5y»*d>%©«»»*»*3 i»5*»A ew*«* »3oa. 

f\ the horizontal axis indicates time. ^Fig i 13a depicts a 

10 synchronizing signal Ck which rises every 1/60 (second) for 

f\ television display, Fig. 13b depicts an operating signal Ss from 

A a hammer-type input device 2, A Fig. l£c - depicts an image signal 

A" Vs sent to the display 9,^-Ifc Lg -. 13d depicts a detection signal 

Cm**** AkfcfWA T**'**^ tU*«* v "»»(«> 

Sh from the hammer-type input device 2, and ^Figi 13» depicts the 
15 measuring time for specifying the screen position. 

In the video block 31, the synchronizing signal is produced 
in the form of a pulse every 1/60 (second), resulting in times 
(\ tl, t2, t3, etc., as shown in. Fig . 13a . As shown in J'ia.Ue , an 
image signal Vs is formed every 1/60 (second) synchronously with 
20 the synchronizing signal by the video block 31 , and is sent through 
the D/A convertor 360 to the display 9. 

The game is now displayed on the display 9 and is in play 
(step 504 in Fig. 10). The subCPU 3 04 executes the process for 
receiving operating signals Ss from the hammer-type input device 
25 2 (step 701 in Fig. 12). When the player holds the hammer-type 
input device 2 but does not operate it, no operating signals Ss 
are output from the hammer-type input device 2, so the subCPU 
304 determines that no operating signal Ss is being detected (step 
701: NO) and moves on to another process. The subCPU 304 executes 
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step 701 in cycles . That is , the subcpu 304 nearly always monitors 
the reference input board 307 to detect whether or not an operating 
signal Ss has been input from the hammer-type input device 2 . 
Here, during game play, the player uses the hammer-type input 
5 device 2 to strike prescribed positions on the display 9 screen. 
The vibration switch 22 of the switch means 20 in the hammer-type 
input device 2 detects impact, and an operating signal Ss is output 
from the vibration switch 22 during the period of time til through 

Of**+*o** Ti~H*^ CX^aoA ^3<>t\ 

A tl2 shown in A Figy 13(b) . The subCPU 304 detects that the operating 
10 signal Ss has been input (step 701: YES), and the main CPU 301 
is notified that the operating signal Ss has been input. 

The main CPU 301 begins the processing needed to obtain the 
point of contact. Specifically, a command to brighten the entire 
screen of the display 9 is input by the main CPU 301 through the 
15 SCU 300 to the video block 31 so as to increase the brightness 
of the entire screen of the display 9 from the subsequent vertical 
/\ synchronizing signal (time t2 . timing - in Fig. 13) in the first 

y/Xfi 3SU> s<?0>04* v)fi 330 

A ^O Pf 3 20 and - 330 , and the time is counted from the vertical 
synchronizing signal (t2) (step 702). The time is counted so as 

20 to obtain data relating to the aforementioned scanning line 
position (scanning point position) based on the vertical 
synchronizing signal. 

In the video block 31, to obtain the photodetector signal 
Sh described below from the point in time at which the subsequent 

25 vertical synchronizing signal was input, such as the time t2 
timing in ^Fig. 13(c) , a high-brightness image signal is formed 
and is given to the display 9 while scanned. Image signals to 
increase the brightness are continuously output from this timing 
to the subsequent timing (time t2 to t3). 
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go main CPU - 301 thon waito foi u u Lifiua ' Cion as Z6 ' whe t 
a photodetector output signal has been input from the subC£U--3l>4 
(step 703: NO AAap 70S - . No . , oto »). In othei>w<5rds, in the 
absence of any notification that a photodetector signal from the 
subCPU 304 has been detected (st^p^703: NO) , the main CPU 301 
determines whether 1/60 (second) has elapsed from time t2 (step 
704). When the main^PU 301 has determined that 1/60 (second) 
has not elap^edsince time t2 (step 704: NO), it then determines 
whether'or not there is any notification that a photodetector 
tjr- fronv the— SAibCPU— 3-e-f has been defected ( step 70~3~) 



Here, it is assumed that no notification of the detection 
of a photodetector signal has been sent from the subCPU 304 to 
the main CPU 3 01 . At that time, when the main CPU 301 determines 
that 1/60 (second) has elapsed since time t2 (step 704: YES), 
it determines that the detection is negative (step 705 ) . The main 
CPU 301 moves to the original game processing (step 706). The 
image signals are thus the image signals accompanying ordinary 

Xwwxjf- s^»m4 Tt*"\»£ CKA«* x'iOlf 

game processing from time t3 and thereafter, as shown in ¥*q: 

A 



-fturtMSefcac** ***** T »'"»'««»s * 3 °* 



Meanwhile, at time t 21 in ^Fig. 13(d) , the main CPU 301 is 
notified by the subCPU 304 that a photodetector signal has been 
detected (step 703: YES) . The main CPU 301 counts the time to 
specify the screen position of the hammer-type input device 2 
striking the screen of the display 9 by the timing of the time 

<W»^ i^tA T*nU* CVtMA 1310 

t2 of the synchronizing signal (see^ig. 13(o), step 707). That 
is, time is counted from the Rimin g (t2) of the beginning of 
scanning to the time\ (t 21 ) A bright light is detected through 
the scanning lines . This time is the data relating to the position 
of the scanning lines obtained on the basis of the vertical 



. 1998* 10198 \nm NO. 6682 P. 72 




22 



synchronizing signal. 

When the time count is completed (step 7 07), the position 
at which the scanning lines run per scan timing is learned, and 
the coordinate position on the display screen struck by the 
5 hammer-type input device 2 is computed based on the counted time 
(step 708). That is, a screen component of the image displayed 
on the display 9 is roughly constructed of a period from one 
synchronizing signal to the next synchronizing signal. As such, 
the time elapsed from the synchronizing signal has a one-to- 

10 one correspondence to positions on the display 9 screen. The 
position on the display 9 screen can thus be specified by 
determining the time elapsed from the synchronizing signal. 

When the position computation is completed, the main CPU 
301 waits until 1/60 (second) has passed from time t2 (step 709: 

15 NO), and moves to the original game processing at time t3 and 
thereafter (step 706). The image signals are thus the signals 
accompanying ordinary game processing at time t3 and thereafter, 

X»/t«y. T\Mll*^ 0*ft* \"*,O10 

IP* as shown in ^fig. 13 

The main CPU 301 thus determines which position on the 

20 display 9 screen has been struck by the hammer head 17 of the 
hammer- type input device 2. The main CPU 301 then determines if 
the object has been properly struck, that is, whether or not a 
certain type of collision has successfully occurred between the 
hammer and object, on the basis of the determined results. This 

25 is referred to as collision determination below for the sake of 
convenience, it is ultimately determined whether or not the 
position of the hammer head 17 on the display 9 screen falls within 
the object region displayed on the display 9. 

The affirmation of collision determination results in image 
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processing corresponding to the successful collision, that is, 
an image such as the disappearance of the object is given to the 
player. A model of the collision determination with respect to 
the object is usually given to accelerate and simplify collision 
5 determination in this collision determination. A rectangular 
model is usually given, where the center of the rectangle is 
modeled as the center of the object, and successful collision 
is determined on the basis of whether or not the position on the 
screen struck by the hammer is within the rectangular model frame. 
10 Naturally, the collision is determined to be successful if the 
struck position is within the rectangular model frame. The 
degree of difficulty for achieving a successful strike can be 
adjusted by selecting a rectangular model of a desired size. The 
probability of striking a position within the frame is greater 
15 with larger rectangular frames than with smaller rectangular 
frames, and the game difficulty can be lowered. The smaller the 
rectangular frame, the lower the probability of a successful 
collision and the greater the game difficulty. The collision 
determination here is rapidly processed by the subcpu 304, and 
20 the main CPU 301 rapidly executes the necessary image processing 
while using the determined results. 

In the embodiment of the invention described above, the time 
was counted with the aforementioned vertical synchronizing 
signal as the starting point so as to obtain data relating to 
15 the position of the scanning lines based on the vertical 

synchronizing signal, but the following structure can also be 
adopted. H (horizontal) and V (vertical) counters are usually 
provided in ordinary video game devices to learn the current 
scanning points, when the counter values are used, and these 
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values are recorded in a latch register or the like when a 
photodetector signal has been detected, data relating to the 
scanning line position based on the vertical synchronizing signal 
can be obtained. 

5 The H counter counts up every time the CRT display scanning 

points move once in the horizontal direction, and is set by the 
horizontal synchronizing signal. The V counter counts up per 
horizontal synchronizing signal every time the scanning lines 
move once in the vertical direction, and is set by the vertical 

10 synchronizing signal. That is, the counter values constantly 
indicate the scanning line position on the display screen. These 
counter values are recorded in the register when a photodetector 
signal has been input- Data related to the scanning line position 
based on the horizontal synchronizing signal is thus recorded 

15 in the register- The CPU 301 reads the register values, and on 
that basis may compute the coordinate position on the display 
9 screen* 

This game device has the following advantages. The object 
that is struck is not mechanical but is provided by images, 
20 allowing for greater freedom and fewer restrictions on the 

selection and design of the shape and behavior of the struck object . 
Images of the struck object, the background, or the like are 
created by software, so a plurality of games may be provided for 
the player with just one game set, for example- Since there is 
25 no need to endow the struck object with mechanical durability, 
the cost can be lowered. The program of the game device described 
here can be used with household game devices using a recording 
medium such as a CD-ROM or ROM cassette. 

As described above, in the first embodiment of the invention, 
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the movement of the object is realized by an image processing 
means, and the prescribed processing is managed on the basis of 
contact data by an input means to a display means where the moving 
object is displayed, so it is possible to give the object a variety 
5 of shapes and movements while providing object movement that is 
not dependent on a mechanical structure, and it is also possible 
to provide input based on contact, such as "whacking," to the 
object, and to execute the prescribed image processing based on 
this input. 

10 In particular, a prescribed relationship between the region 

where the object is and the point of contact where the input device 
is brought into contact with the display means, such as whether 
or not the point of contact is in the region where the object 
is (whether or not a certain type of collision has occurred between 
15 the two ) , is determined - Thus , even though the ob j ect is provided 
by image processing, a player or operator can still be provided 
with a state as to whether or not the object has been successfully 
"whacked." The game device pertaining to the present invention 
thus allows scored games to be played by means of this 
20 determination. 

The display means is provided with a protective cover, 
allowing the durability of the display means to be improved. This 
also affords a display means allowing the input means to be brought 
into direct contact while protecting the display. 
25 The normal line of the image display surface of the display 

means forms an angle ranging from 3 to 17 degrees with respect 
to the vertical direction, thereby making it relatively easier 
to bring the input device into contact with the display means. 
The input device is equipped with a switch means enabling 
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the output of contact data when brought into contact with the 
display means, thereby preventing the unintentional output of 
data when no contact has been made. A vibration switch 
successfully ensures this. 
5 The apparatus in the first embodiment of the present 

invention can also be constructed in such a way as to be equipped 
with a photoreceiver means for light emitted from the scanning 
lines of the CRT display serving as the display means, wherein 
a position computing means begins a process necessary for 

10 obtaining points of contact based on the output from the switch 
means, data on the scanning points obtained on the basis of 
scanning synchronizing signals is accepted when a detection 
signal is input from the photoreceiver means, and the point of 
contact can be computed on the basis of this data, allowing the 

15 point of contact to be accurately and rapidly computed. 

The input means is equipped with a buffer for softening the 
impact during contact at the location of contact with the display 
means, so as to improve the durability of the input means and 
display means. 



Embodiment 2 of the Invention 



Pr Fig. 14 depicts a second embodiment, in which^tJte input 

device of the present invention is described in further detail, 
25 Fig. 15 is a schematic depicting an example of the structure of 
A3 rh^""^^ hrmnM i n n h ni m nr r t y pr inp ut , d r u ino 

The hammer-type input device 2a comprises a switch means 
20a which outputs an operating signal when the input device 
collides, and an optical guide means (optical fiber) 43 for 
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guiding light obtained from the aforementioned display 9 to a 
photodetector substrate 23a (exactly same structure as that of 
photodetector substrate 23 in Fig- 6) for obtaining a signal to 
specify the position on the display 9 screen. The hammer-type 
5 input device 2a is also provided with a handle 16a and hammer 
head 17a in the same manner as the hammer-type input device 
described above. The hammer head 17a is constructed in 
cylindrical form, with an opening provided at one end of this 
cylinder. A buffer 19 in the form of a cylindrical bellows is 

10 secured to the opening. Optic fiber 43 is supported and fixed 
while extending inside the handle 16a and head 17a toward the 
opening of the hammer head 17a, and the tip of the optic fiber 
terminates facing the open end of the buffer material around the 
base end of the buffer material 19. 

15 The base end of the optic fiber 43 is connected to the 

photoreceiver sensor of the photodetector substrate 23a in the 
case unit 3. In the hammer described here, light coming from the 
opening of the hammer head 17a is guided through the optic fiber 
43 to the photoreceiver sensor of the photodetector substrate 



The switch means 20a housed inside the hammer- type input 
device 2a is composed of a vibration switch 22a provided inside 
the handle 16a, for example, as shown in Fig. 15. The vibration 
switch 22a is provided with an automatic reciprocating-type a 

25 contact which consists of a weight 41 having a specific weight, 
a contact 42 that flexes according to the moment acting on the 

H weight during contact, and a fixed contact 44. ^ 



When a certain level of impact force acts on the hammer head 
17a, the flexible contact 42 bends down until in contact with 



20 



23a. 
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the fixed contact 44, the switch 22a closes , and the flexible 
contact 42 then automatically returns to the position shown in 
Fig, 15, 

Tiu$ A$ Tfrc oymbol 45 io a ba-oo-which - is formed of an j^ s^Aa^M^» 

5 mato - gial - and JtfhAefrsupports the contacts while keeping them apart . 
The base^is fixed inside the handle 16a. The signals from the 
switch mechanism 43 are input through a signal line 26 to the 
reference input board 307 of the CPU block 30. 

In this hammer- type input device 2a, the photodetector 
pi 10 substrate^^ar is not housed inside the handle 16a or hammer head 
17& but is located in the case unit side, so the durability of 
p\ the photodetector substrate^-23- can be improved, and erroneous 
photodetection potentially caused by direct impact or the like 

a** 

A to the photodetector substrate A *> can also be avoided. 
15 

Embodiment 3 of the Invention 

Fig. 16 is an A oi>liqu(> view depicting another embodiment of 
the present invention. The input device 2b in this embodiment 
20 is a sound detector type rather than the photodetector type 
described above. The input device 2b consists of a hammer 52 
housing a switch means 20b, and sound detector means (microphones) 
53a through 53d located at the four corners of the display 9, 
The switch means 20b is connected to the reference input board 
25 307 of the CPU block 30. 

The microphones 53a through 53d located in the four corners 
are connected to the reference input board 307 of the CPU block 
30 through^ sound processing devices not shown in the figure. 
^ Here, when the protective glass lO^on the screen of the 
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display 9 is struck with the hammer 52, resulting sound is produced 
by the compression of the bellows caused by the impact. The sound 
is captured by the microphones 53a through 53d- The sound signals 
output from the microphones 53a through 53d are given through 
5 the sound processing devices (not shown in f igure) , reference 
input board 307 , and subCPU 304 to the main CPU 301,. The main 
CPU 301 executes position computations for specifying the 
position on the screen based on the sound signals from the 
aforementioned sound processing devices when an operating signal 
10 Ss has been input from the switch 20b in the aforementioned input 
device 2b. Coordinate positions on the screen can thus be 
specified. 

This position computing by the main CPU 3 01 is described 
in detail based on Fig, 17. 
15 As shown in Fig. 17, X is the distance between microphones 

53a and 53d as well as between 53b and 53c, while Y is the distance 
between microphones 53a and 53b as well as 53d and 53c When the 
hammer 52 has struck a point P, the coordinate position on the 
screen can be specified by determining the coordinates (x,y) at 
20 point p. The location of microphone 53b is the point of origin 
(the point of origin may be another position such as 53a). The 
distances between point P and points 53a, 53b, 53c and 53c are 
A, B, C, and D, respectively (only B and C indicated in Fig- 17). 

In Fig. 17, coordinates (x, y) are determined by the 
25 following equations. The equations are derived as follows. 

For the x coordinate: 

x = (B 2 + X 2 - C*)/2X (1) 

or: 

x = (A 2 + X z - D 2 )/2X (1' ) 
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For the y coordinate: 

y = (C 2 + Y 2 - D 2 )/2Y (2) 

or: 

Y = (B 2 + Y 2 - A 2 )/2Y (2' ) 

5 However, since X and Y can be known beforehand, they should 

be recorded in memory as parameters. The distances A, B, c, and 
D can be obtained by measuring the arrival time of the signal, 
ft The time at which the hammer^has struck can be known on the basis 
of the switch means 20b, and the sound can be measured on that 
10 basis , allowing it to be readily known how much time the sound 
has taken to reach the microphones 53a through 53d when struck. 
Here, the distances A r B, C, and D are as follows, where the times 
needed to reach the microphones 53a through 53d are tA, tB, tc, 
and tD, and the sound propagation rate on the protective glass 
15 10 is s. 

A = S - tA, B = s - tB, C = S - tC, D = s • tD (3) 
Times tA, tB, tc, and tD are measured as follows, for example. 
A signal from the switch means 20b triggers the time count, and 
the count is stopped when the microphones begin to output sound 
20 signals. The counted results correspond to the arrival time. 
Because the measurements sometimes do not go very well depending 
on the acoustic waveform, the calculations are done with Equations 
1 and 2 or 1 1 and 2' using data with stable output waveforms, 
Both sets may be used in calculations, and the mean of the two 
25 results may be used as the coordinates for point P. 

The derivation of Equations 1 and 2 are described below. 
In Fig, 17, the relation expressed by the following equation 
is obtained from the cosine rule for the triangle P-53b-53c , where 
u is the angle at point P-53b-53c. 
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C 2 = B 2 + X 2 - 2BX • cos u (4) 
From Fig. 17 , it is clear that: 
x = B • cos u (5) 
(5) is substituted into (4): 
5 c 2 = B 2 + X 2 - 2 x X (4) 

The following equation is thus obtained, 
x = (B 2 + X 2 - C 2 )/2X (1) 
The same is true for Equation (2). 

Instead of determining the arrival times tA, tB/ tC, and 

10 tD, the difference between arrival times, that is, (tA - tB), 
(tA - tC), (tA - tD), or the like may be determined, and point 
P may be determined on that basis . The difference in arrival times 
(tA - tB) means that the difference between the distance from 
microphone 53a and the distance from microphone 53b is s(tA - 

15 tB). The point set meeting these conditions describes a 

prescribed curve (hyperbola), where point P is at least on the 
curve. The same is true of (tA - tC) , (tA-tD),etc. Accordingly, 
the intersection of these curves is point P. 

In this method, there is no need to accurately determine 

20 if the hammer 52 has struck. Since the switch means 20b need only 
detect that the hammer 52 has struck, the detection mechanism 
is simple. For example, if the hammer 52 has struck when the 
microphones 53 have detected sound of at least a certain level, 
the switch means 20b is unnecessary. This is advantageous for 

25 actual measurement. Actual sound signals are complex, and it is 
difficult to recognize a specific component such as the rise 
component of a sound signal, so errors tend to occur in the 
measurement of the times tA, tB, tC and tD. By contrast, to 
determine (tA - tB), (tA - tC), (tA - tD), etc*, it is preferable 
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to compare two sound signals to check their difference from each 
other. Specifically, the correlation is determined as the two 
times are varied, and the maximum time deviation among the 
resulting correlations is (tA - tB). This treatment is capable 
of accurate measurement by comparison of the sound signals in 
their entirety. 

This input device 2b has a simple structure because the 
microphones 53a through 53d may simply be set up. Here, 
microphones were described as detecting the sound of contact 
between the hammer^and protective glass^, but vibrations produced 
Pt by contact between the hammer A and protective glass^may also be 
detected by a vibration sensor. 
u b *i» f AsStructure that can be adopted to detect positions on the 
display sdxeen struck by the hammer (Although described above, 
15 it should be reiterated that the hammer does not directly strike 
the display; the ha^smer strikes the protective glass, and 
coordinates where the position of the struck protective glass 
corresponds to the display >s^reen are computed. ) is to set up 
an ultrasonic emitter in the hammerhead, and to set up microphones 
capable of receiving ultrasonic waves^at the four corners of the 
display. 

In this structure, an operating signal Ss is output from 

the switch means^when the hammer^ strikes the protective glass^ 

(k over the displa^. When the operating signal Ss is input to the 
30 

CPU block, an emission signal is supplied at a constant time from 
the CPU block^to the ultrasonic emitter. This allows output of 
ultrasound from the hammer head at a constant time from the time 
the glass is struck. The ultrasound is detected by the 
A microphones^ in the four corners of the display/^and is sent to 
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the CPU block. This allows the position where the hammer head 
strikes the protective glass to be computed, in this structural 
example, ultrasound is emitted and is detected by microphones, 
allowing the coordinate position on the display to be specified, 
5 so positions can be accurately detected without the erroneous 
detection of other sounds. 

($3*- 53d) 

^ In the embodiment described here, microphones^were located 

in the four corners of the display, but they may in theory be 



located in two corners. 



A protective glass^may be provided as a touch panel on the 
(\ display screen so that signals from positions where the touch 
f\ panel has been touched by an input means such as a hammer^ can 
be used as signals to compute the position. 

As described above in the third embodiment of the invention, 
15 the position where a hammer 52 strikes is detected by a sound 
(or vibration) detector means arranged in the four corners of 
the display 9, so there is no need to house a photodetector 
substrate or photoreceiver sensor in the hammer 52, and the 
structure of hammer 52 can be made simpler and more reliable. 
20 It is als9 more light-weight, and is easier for a player to handle. 
It is also possible to dispense with a switch means in the hammer 
52, making the structure even simpler and more light-weight. In 
this case, there is no need for signal lines to connect the hammer 
52 and the data processing board 15, resulting in better player 
25 operability. 



